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Abstract 

The 331 model, an extension of the standard electroweak theory to SU(3)l x 
U(l)x, naturally predicts three families of quarks and leptons via the re- 
quirement of anomaly cancellation. This is accomplished by making one of 
the quark families transform differently from the other two, thus leading to 
flavor changing neutral currents. Using experimental input on neutral meson 
mixing, we show that the third family must be the one that is singled out, at 
least up to small family mixing. We additionally describe a convenient way to 
parametrize the new mixing matrix that plays a role in the gauge interactions 
of the ordinary quarks with the new 331 quarks. 
PACS numbers: 12.15.Cc, 13.15.Jr, 11.30.Hv 
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The 331 model is an SU(3)l X U(l)x extension of the standard SU(2)l x U(l)y elec- 
troweak theory This model attempts to answer the family replication question by 

relating the number of families to the number of colors via the requirement of anomaly can- 
cellation. While anomalies cancel for each individual family in the Standard Model (SM), 
they only vanish in the 331 model when all three families are included. This novel method 
of anomaly cancellation requires that at least one family transforms differently from the 
others, thus breaking generation universality. A result of this is that the 331 model suffers 
from potentially large flavor changing neutral currents (FCNC). Unlike generic grand unified 
theories where FCNCs may be suppressed by large masses, there is an upper bound on the 
scale of 331 physics on the order of a few TeV @||. 

The 331 model predicts several new gauge bosons beyond the SM. These are a new 
neutral gauge boson Z' and a dilepton gauge boson doublet (Y ++ , Y + ). Both the Z' and new 
neutral scalars may have flavor changing interactions with the quarks. Since the leptons are 
generation universal, they couple diagonally to the Z' (however tree level dilepton exchange 
may be lepton flavor violating Q). Thus Z' FCNC is present only in the hadronic sector of 
the 331 model. 

Previous analyses of Z' FCNC contributions to neutral meson mass splittings have at- 
tempted to put a lower bound on the allowed Z' mass [0. However, it has since been realized 
that unknown mixing parameters beyond the ordinary CKM matrix prevent one from mak- 
ing quantitative statements about such a lower bound |||5|]. In this paper, we show that 
while Z' FCNC constraints do not rule out the 331 model, the theoretical upper bound on 
the Z' mass may instead be used to greatly restrict the unknown mixing parameters. This is 
essentially the opposite approach from that taken previously [|l],[||5[ . Additionally, we clarify 
some of the confusion over whether the first or the third family of quarks must be taken to 
transform differently. 

In order to understand the origin of the Z' FCNC in the 331 model, we begin by describing 
the fermion representations. While all three lepton families are treated identically, anomaly 
cancellation requires that one of the three quark families transform differently from the 
other two In particular, cancelling the pure SU(3)l anomaly requires that there are 

the same number of triplets as anti-triplets. Putting the three lepton families in as anti- 
triplets, and taking into account the three quark colors, we find that two families of quarks 
must transform as triplets and the third must transform as an anti-triplet. 

In terms of weak eigenstates, we do not need to distinguish which family falls in the 
anti-triplet. However, as we demonstrate later, it is convenient to think of the different 
family as the third family. We thus denote the first two families as 
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and the third family (anti-triplet) as 

[ b \ 

Qz= -t . (2) 

The sign ensures that the SU{2) L quark doublet, when embedded in SU(3)l, has the con- 
ventional form. 

Using the standard normalization of non-abelian generators, the hypercharge is embed- 
ded in SU(3)l x U(l)x as Y/2 = \^3T 8 + X where X is the U(l)x charge of the represen- 
tation (we use the conventions of The electric charge is then given by Q = T 3 + Y/2 
so that Y corresponds to twice the average charge of SU{2)l representations. From these 
relations between Q, Y and X, we find that the electric charge of each component of SU(3)l 
(anti-)triplets changes by exactly one unit and that the X charge is given by the average of 
the electric charges (which is just the electric charge of the middle component). Thus the 
triplets, Qi and Qi above, have X = —1/3 and the third quark family, Q 3 , has X = 2/3. 

There are then three new quarks which we denote D and S with electric charge —4/3 
and T with electric charge 5/3. Note that all fermion states given here are weak interaction 
eigenstates and must be related to physical (mass) eigenstates by the appropriate unitary 
transformations. Unlike the left-handed representations, all right handed quarks are incor- 
porated as SU(3)l singlets. As a result, the ordinary right handed quarks are generation 
universal and hence Z' FCNC is limited to the left handed interactions. 

When 331 is broken to the SM, the neutral gauge bosons W® and X M mix to give the 

and hypercharge gauge bosons. This mixing may be parametrized by a 331 mixing 
angle #331 (generalizing the Weinberg angle) defined by @| 



-^=g cos #331 = ~^9x sin 9 331 



(3) 



where g and gx are the SU(3)l and U{l)x coupling constants, and the hypercharge coupling 
constant g' is given by taxiOw = g'/g- In terms of W* and X^, the hypercharge and Z'^ 
gauge bosons are given by a rotation parametrized by # 33 i 

fB„\ 



\ ( cos 331 sin 6>33i 

V - sin 6*331 cos 6*331 ) \X^ ) 

Since the Z' is a combination of W 8 and X, it couples to fermions according to 



(4) 
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C = Z> ^[cos 2 0331172 - 7> • (5) 



sin #331 " 



Using cos #33i = \/3tan#v^) this may be rewritten as 



9 L 

cos W 2 ^Jl-4sin 2 # w 



^ = , „. ^ > (6) 



where is given by 

J£, = ^ [3 sin 2 9 W Y - 2 V% cos 2 fl^T 8 ] ^ . (7) 

Since the value of T 8 is different for triplets and anti-triplets, the Z' coupling to left- 
handed ordinary quarks is different for the third family and thus flavor changing. If we 
assume Jz> has a "standard" form for quark triplets, then the flavor changing interaction 
occurs for the third (weak-eigenstate) family and may be written as 

J z'(fcnq = -2^3 cos 2 6 w q^ lL [T\r) - T 8 (3)}q = 2 cos 2 6 w q^ lL q , (8) 

for both up- and down-type quarks (7^ = |(1 — 7 5 ) is the left-handed projection operator). 
Other than in the scalar sector, this is the only tree level FCNC interaction present since 
when 331 is broken to the SM, all three families of ordinary quarks are in usual SU(2)l 
doublets and thus couple in the ordinary manner to the Z and photon. 

The dilepton currents are also sensitive to the SU (3) l structure of the quark represen- 
tations, and hence the difference in the third family. However, with only ordinary external 
quarks, these dilepton effects first show up at loop level. Since tree level Z' FCNC presum- 
ably dominates over loop processes, a good place to study the effects of dilepton exchange 
on flavor changing interactions would be in the process b —>■ sj which cannot occur at tree 
level. 

After SU(2)l x U(1)y breaking, the weak eigenstate Z and Z' may mix, forming mass 
eigenstates Z\ and Z 2 . This mixing of the neutral gauge bosons may be parametrized by a 
mixing angle so that 



Z\\ ( cos cf) — sin <p\ f Z 
Z 2 J V sin cos / \ Z 



(9) 



A fit to precision electroweak observables gives a limit on the mixing angle of —0.0006 < 
< 0.0042 and a lower bound on the mass of the heavy Z 2 of M Za > 490GeV (both at 90% 
C.L.) 0. While this mass limit is not as strong as the indirect limit Mz 2 > 1.4TeV given 
by the dilepton mass bound and the M Z2 -M Y relation of the minimal Higgs sector p|, it is 
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insensitive to the choice of Higgs representations and provides an independent lower bound 
on M Z2 . 

Due to the mixing, the mass eigenstate Z\ now picks up flavor changing couplings pro- 
portional to sin0. In particular, using (|) and (||), we may write || 

£fCNC = r- I 1 9 = (~ Sil1 + C ° S ^ 2 m) J ^'(FCNC) • ( 10 ) 

cos ^2 v / 3\/l -4 sin 2 9 W 

For sufficiently large mixing, the flavor changing Z\ decays may be observable. However, 
because Z-Z' mixing is constrained to be very small, evidence of 331 FCNC can only be 
probed indirectly at present via the Z 2 couplings. 

In order to examine the flavor changing Z' interaction given in (||), we need to relate 
weak and mass eigenstate quarks. Symmetry breaking and mass generation in the minimal 
331 model is accomplished by four Higgs multiplets — the three triplets 

-CD -CD '-£)■ 

with X charges 1, 0, and —1 respectively and a sextet H with X = We have 

written the triplets in terms of SU(2)l component fields: <E>y = ($y + , $y) T , the Goldstone 
boson doublet corresponding to the massive dileptons and $j = (<pf , 0°) T , which are SM 
Higgs doublets where $j = ir 2 $*. A third SM doublet arises from the sextet H, but plays 
no role in generating quark masses. 

The vacuum expectation value ($) breaks 331 and gives masses to the new quarks D, 
S, and T. The remaining scalars implement SU(2)l x U(l)y breaking and gives masses to 
the remaining fermions. In particular, the most general gauge invariant Yukawa couplings 
of the above scalars to the quarks may be written 

- C = Q^hfd'^ + Q^ 3 hf d' Rk r 

+ QtKD' Rj ® + W,h T T R ^ + h.c. , (12) 

where i, j = 1,2 runs through the first two families only and k = 1,2, 3. As usual, the primes 
denote weak eigenstates. Since T is the only charge 5/3 quark, it is a simultaneous gauge 
and mass eigenstate. 

When 331 is reduced to the SM, the Yukawa interactions may be written in terms of 
ordinary left-handed quark doublets qu = (ui, and singlets. We separate C into two 
pieces, Cq which contains only lepton number L = scalars and Li which has \L\ = 2 scalars 
that change ordinary and new quarks into each other. We find 
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q'uhfd'^ + q' L3 hfd' Rk $ 2 



-c 2 



+ D' Ll h%D' Rj ^ + T L h T T Rlfi °* + h.c. 

&iD' Rj ^ Y - ~& z h T T R §y 



+ D' Ll hfd' Rk A- + D' Ll VS Rk p- 

+ T- L hfd' RkP ++ - T- L tfNm4>' + + h-c • 



(13) 



Because the third family of quarks is treated differently, it has different couplings to scalars 
as well as the Z' . Thus natural flavor conservation || is necessarily violated in the 331 model, 
leading to potentially large flavor changing neutral Higgs (FCNH) processes in addition to 



If it were not for the third family, the ordinary quarks in £ would have a normal two 
Higgs doublet coupling with separate Higgs couplings to up- and down-type quarks (usually 
referred to as model II). The third family, however, has a "flipped" coupling, with $i and 
$ 2 exchanging roles. Including the SU(3)l sextet Higgs which give masses to the leptons, 
we end up with a three-Higgs doublet model, albeit with unusual Yukawa couplings dictated 
by the underlying SU(3)l theory. 

Since the Z' couples differently to the third weak-eigenstate family, Z' FCNC occurs 
through of a mismatch between weak and mass eigenstates. Since there are more states than 
in the SM, this mixing is described by more than just the CKM matrix. The charge 2/3, —1/3 
and —4/3 mass matrices are diagonalized by three independent bi-unitary transformations 
which we denote by the 3x3 unitary matrices Ul,r and Vl,r and the 2x2 unitary matrices 
Wl jR respectively. In the standard fashion, the ordinary CKM matrix is given by Vckm — 
U\V L . The new mixing shows up in both dilepton currents and the FCNC part of the Z' 
interaction. 

Because the first two families are generation symmetric, we may make a convenient choice 
of letting D and 5* be simultaneous gauge and mass eigenstates. This replaces the standard 
choice of using up-type quarks in this fashion which is no longer possible in this case. As a 
result, the charged currents in the quark sector and the Z' FCNC interaction may be written 



Z' FCNC. 



w+ — 



U^^ L V C KMd 

/l 0\ 

d^j L Vl 1 £> + 2V7 L (0 l)U L u 
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J Z'(FCNC) 
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D - T^ lL (0 l)V L d 



2 cos 8 w [ui^1lU^ 
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U L u + d^lLVl 
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(14) 
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in a matrix notation where -D = (D, S) T . If we had not initially picked D to be generation 
diagonal, we could simply have absorbed the unitary matrix Wl into a redefinition of Ul 
and Vl- 

Unlike the SM where only Vqkm is physical, there is additional freedom in the mixing 
present above ||. Although we have introduced three matrices in (0), they are not in- 
dependent but are related by Vqkm — U\V L . Since flavor changing interactions involving 
down-type quarks have been studied the most extensively, we find it convenient to specify 
the two unitary matrices Vqkm and Vl- As usual, Vckm contains three angles and one 
complex phase. Vl is specified by three angles and three phases since we may remove three 
phases from the general unitary matrix by appropriately transforming the three new quarks. 

In the absence of CP violating phases, the three angles of Vl have a simple interpretation. 
We may use a CKM like parametrization 



V T . 



where s,- 



/ Vld v ls 
V2d V 2s 
\V 3 d v 3s 



Vlb\ 
V 2 b 



( C12C13 -S12C23 - C12S23S13 S12S23 - C12C23S13 \ 

S12C13 C12C23 — S12S23S13 — C12S23 — S12C23S13 
V S13 S23C13 C23C13 / 



(15) 



sin^j and c^- = cos^-. Since the third row corresponds to the anti-triplet weak 



eigenstate, #13 and #23 specify which down-type quark is in the anti-triplet and, orthogonal 
to that, 9 12 specifies the mixing between the first two triplets {i.e. D and S). 

Previous examinations of the Z' in the 331 model have concentrated on putting lower 
bounds on Mz 2 to prevent excessive tree-level FCNC. The drawback to this approach 
is that the new mixing specified by Vl is in principle unknown and has to be estimated. 
Here, we instead use the upper limit Mz 2 < 2.2GeV to place restrictions on Vl- 

The strongest constraints on tree level Z' FCNC come from neutral meson mixing. For 
the neutral kaon system, the tree level AS = 2 interaction is given from (|5p and (ITO) by 



n 



AS=2 
eff 



9 2 c 2 



cos 



12(1 -4s 2 ) 



Ml 2 



+ 



sin 



Ml 



(16) 



where s = sin9w and c = cos9w- In addition to the SM box diagram and possible long 
distance effects, this contributes a term 
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AmK = ~Y~ Gf (i - 432) 1^ ^3 d\ 2 (vz 2 cos 2 (f)^- + rj Zl sin 2 ^ B K f K m K , (17) 



to the K —K° mass difference [10|. We have included the leading order QCD corrections 



through the parameters r]z 2 ~ 0.55 and r\z x ~ 0.61 [TT[. Bk and /r- are the bag parameter 
and decay constant of the kaon. Similar equations hold for D°-D° and B°-B° mixing. 
Because the Z-Z' mixing angle <ft is very small, the first term in the parentheses dominates 
and sin 2 may safely be neglected. 

The present limits on neutral meson mixing are given by [ |12]j 

K°-K° Am = (3.522 ± 0.016) x l(T 12 MeV 

D°-W < 1.3 x l(T 10 MeV (18) 

B^-W = (3.6 ± 0.7) x l(T 10 MeV . 

Although there is considerable uncertainty in the heavy meson decay constants, this has 
little effect on the results. We use 

\[fycf K = 135 ± 19MeV 
^B~ D f D = 187 ± 38MeV 

s/RbJb = 208 ± 38MeV . (19) 
The kaon quantity comes from fx = 161MeV and Bk = 0.7 ± 0.2. The heavy meson decay 



constants are taken from a lattice calculation, Ref . |L3| , where all reported errors are added 
in quadrature and B D = B B = 1. 

Because there are various sources that may contribute to the mass difference, Am, it is 
impossible to disentangle the tree level Z' contribution from other effects. However, barring 
any unexpected cancellations, it is reasonable to expect that Z' exchange contributes a Am 
no larger than the observed values. Using the upper limit, Mz 2 < 2.2TeV, we find, from the 
K°, D° and B° system, respectively 

\v* 3s v M \< 5.0 xlO- 3 
\u; c u 3u \ < 10.8 x io- 3 

K>3dl< 8.7 xlO" 3 , (20) 

(at 90%C.L.). u 3 i are components of the third row of Ul, the rotation matrix in the up-quark 
sector, and are given by u u = v 3j V£ KMij . 

It should now be apparent why we have chosen to parametrize the new mixing by Vl- 
In this case, we make it easy to describe FCNC in the more interesting K° and B° systems 
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at the expense of the D°. In the parametrization of Vl given by Eq. fll5|) , v^i is determined 
(in magnitude) by two angles, # 13 and 2 3- Since Iv^^l = § 1 sin 23 sin 2# 13 1 and |f 3fe f 3rf | = 
|| cos 6* 23 sin 26*13 1 , we immediately determine from (^Dj) that | sin2# 13 | < 0.020, giving |0 13 + 
n7r/2| < 0.010. This allows two types of solutions, either |f 3( ^| ps (the second or third 
family is the anti-triplet) or |v 3t j| ps 1 (the first family is the anti-triplet). 

In order to restrict these cases further, we must relate to f 3 « and take the limit on 
D° mixing into account. This requires knowledge of Vqkm and possible new CP violating 
phases as well. We find that in order to satisfy all three conditions of (|20"D simultaneously, 
only |i>3d| ps is allowed. Restricted to the first quadrant, the limits on 9ij are 

#i 3 < 0.010, 6 23 < 0.26 , (21) 

which means |i>3&| ~ 1 and hence that the third family must be the anti-triplet (up to small 
mixing) . 

There has been some confusion over the issue of whether the first family or the third 
family must be treated differently in order to sufficiently suppress the Z' FCNC [|l]|j|||. 
Obviously, in terms of weak eigenstates, it makes no difference which family is assigned to 
the anti-triplet. In terms of mass eigenstates, the anti-triplet has been unitarily transformed 
into some combination of all three families. However, physically, the almost- diagonal CKM 
matrix tells us that it makes sense to group mass eigenstates into families. It is in this 
manner that we may say the third family must be the one that is different. The reason this 
choice is forced on us is because the Cabibbo angle, sin 6*c ~ 0.22, is the largest off-diagonal 
element of Vqkm, and hence the AS" = 2 and AC = 2 FCNC limits cannot be simultaneously 
satisfied unless the anti-triplet is in the third family. 

When Bg mixing is measured, it will put further stronger restrictions on 623. In the SM, 
ArriB d / Am Bs ~ | VcKMtd/VcKMts\ 2 so B° s mixing is expected to be large. Although this box 
diagram contribution is still present in the 331 case, if we assume that the tree level process 
dominates, we find instead ArriB d / AmB s ~ |f 3 d/f 3s | 2 = | tan #13/ sin 6*23! 2 ■ Depending on 
the new mixing angles, the Z' contribution to B° s mixing may be large or small. Even if 
this mixing turns out to be unexpectedly small, it will not rule out the 331 model. Because 
of the additional freedom present in Vl, there is a possibility that tree level Z' exchange 
has the opposite phase as the SM box diagram, and hence would suppress the large SM 
contribution to Ams s . This intriguing possibility of small B° s mixing would present clear 
evidence of physics beyond the SM, including possible support for the 331 model. 

Tree level Z' exchange also contributes to AS = 1 FCNC processes such as K — > irvV. 
We find 
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BR(K + -> k+w) _ c 4 fe/ L s 2,^i + sin2 ,V (22) 
BR(fT+ - vr°e+z, e ) " 3 |K OT J 2 1 Mf 2 + J ' {22) 



Since BR(fT + — > it + vv) < 1.7 x 10 8 fl4j], we use the upper bound on M Z2 to find l^i^l < 



0.18 which is a weaker limit than that from K°-K° mixing, Eq. (p0|). Similar considerations 
hold for the rare decay K\ — > However, it is theoretically harder to treat because of 

long-distance contributions. The reason such semi-leptonic decays do not give strong mixing 
constraints is that the Z' is only weakly coupled to the leptons. 

While the above processes occur at tree level via Z 1 exchange, the rare decay b — *■ 57 
must still proceed at one-loop. In the 331 model, in addition to the SM W penguin, this may 
occur via Z' and Y penguins. Although the SM contribution is GIM suppressed, this is no 
longer the case for both 331 contributions. One might worry that this would lead to too large 
a rate for b — > 57. However, the non-GIM suppressed contributions are proportional to new 
mixing given by v^ b v 3s , which may be sufficiently small to prevent conflict with experiment 
[ 15 1 . This is currently under investigation |T6| . 



In conclusion, FCNC occurs at tree level in the 331 model because of the Z', which 
couples differently to triplets and anti-triplets. In order to describe the flavor changing Z' 
interaction, we need to understand family mixing in the quark sector, which is complicated 
by the presence of the new quarks. In addition to the ordinary CKM matrix, three more 
angles and three new phases are required to describe the mixing between ordinary and new 
quarks. Although we have not focused on the three new CP violating phases, they may lead 
to striking predictions beyond the SM and deserve further investigation. 

We find that the only way to satisfy the experimental constraints on FCNC is to make 
the third family transform differently from the other two (up to small mixing). The reason 
behind singling out the third family is that it has the smallest couplings to the other two 
families — the Cabibbo angle mixing is sufficiently large that it forces the first two families 
to be treated identically. Because of the almost diagonal family structure, it makes physical 
sense to group either weak or mass eigenstate quarks into corresponding families. This is 
why it is convenient to think of the third family as unique, even in terms of weak eigenstates 
although technically it makes no difference. 

Going back to the quark Yukawa couplings, (|T3|), we note that since the Higgs couplings 
to the third family are different, FCNH will occur in the scalar sector. However, the Z' 
FCNC constraint, (|2lD , will simultaneously suppress FCNH by restricting the third family 
to be almost diagonal. Thus the SM Yukawa interactions are similar to that of the two-Higgs 
doublet model II with the exception that t and b get their masses from the opposite Higgs 
doublet as for the first two families. 
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Because of the unique feature that there is an upper bound on the unification scale, the 
331 model is highly predictive. It is remarkable that in this model, there is just enough 
freedom to eliminate large FCNC, and the result of this is to constrain the third family to 
be the one that is different. In turn, this may give us some indication of why the top quark 
is so heavy and may present a new approach to the question of fermion mass generation. 
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and J. Agrawal, P. Frampton and P. Krastev for enlightning discussions. This work was 
supported in part by the U.S. Department of Energy under Grant No. DE-FG05-85ER- 
40219 and the National Science Foundation under Grant No. PHY-916593. 
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